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Description 

" Method for inter-domain multipath routing 

5 The invention relates to a method for optimized inter-domain 
routing between packet-oriented networks and a method for 
determining paths for multipath routing in a packet-oriented 
network, including the distribution of packets over a plurality 
of links connecting different packet-oriented networks. 

10 

Arguably one of the currently most important developments in 
the area of networks is the improvement of packet-oriented 
networks in respect of functions for routing real-time traffic 
such as voice traffic or video transmissions. 

15 

The majority of the protocol stacks for routing data packets 
use the Internet Protocol, mainly abbreviated to IP protocol in 
the technical literature, on what is referred to as the network 
layer. The IP protocol allows data to be switched via various, 
20 in some cases technically different, networks. The IP protocol 
• on the network layer provides routing information which can be 
interpreted by all the networks involved in routing. The most 
important information of this kind is address information. 

25 In the context of the IP concept, individual networks with a 
uniform routing technology are also known as routing domains, 
autonomous systems or sub-networks. In the following, the term 
network will be used to denote a network within which uniform 
routing mechanisms are used, and not a network of networks. 

30 

A network is generally organized by a network operator having 
certain freedoms in respect of the routing mechanisms used. 
Within IP networks, the OSPF (open shortest path first) 
protocol is normally used for routing. The OSPF protocol is 
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what is termed a linked state protocol whereby routing tables 
are established or adapted to provide optimum routing by means 
of the exchange of topology information between the routers or 
nodes . 

5 

For routing within packet-oriented networks there are methods 
based on the conventional protocols for improved routing in 
respect of compliance with quality of service features which 
are essential for real-time traffic. 

10 

One approach is by means of the MPLS (multiprotocol label 
switching) method. As part of this method, paths are defined by 
the network. The path through the network is specified and the 
corresponding packets are identified by labels or information 

15 fields according to the destination to which the traffic is to 
be forwarded or according to the address information contained 
in the packets. The labels then determine the routing onto a 
path through the network. A refinement of the MPLS concept is 
provided by multipath routing whereby traffic is transmitted 

20 via several MPLS paths to an edge node of the network 
(multipath MPLS) . Another concept, the ECMP (equal cost 
multipath) method, involves the distribution of traffic over 
equivalent paths in terms of a metric or cost function. 

25 Another approach for improving routing within a network ( intra - 
domain routing) is being developed as part of the KING . (Key 
components for the mobile Internet of Next Generation) project. 
The aim of this concept is to avoid the complexity of the MPLS 
method while nevertheless allowing routing with maintenance of 

30 quality of service features. With MPLS, states must be defined 
or retained network-wide. The routing or, in the case of 
multipath MPLS routing, the distribution of packets is 
specified on entry to the network. Information about the paths 
used and their capacity utilizations must be held and evaluated 
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centrally in order to enable the bandwidth to be used so as to 
maintain quality of service features. In the KING project, the 
information required centrally or at the edge of the network is 
greatly reduced by essentially keeping the locality of the 
5 routing decisions as in the conventional IP network. Critical 
aspects of the concept are: 

• traffic controls at network entrance and exit 

• transmission of traffic from an entry point to an exit point 
along multiple paths (multipath routing) 

10 • distribution over different paths and re-distribution in the 
event of disturbances by means of local routing decisions 

The idea behind the concept is that only the aggregated traffic 
volumes are controlled at the network boundaries. Distribution 
15 within the network is ensured by suitable local measures 
designed to prevent bottlenecks. 

As well as optimized routing within the networks involved, 
routing between the networks is crucial for efficient global 

20 data transmission. Data is currently transmitted between IP 
networks (inter-domain routing) by means of BGPs (border 
gateway protocols). In the case of the BGP protocol, the edge 
nodes of neighboring networks exchange reachability data with 
respect to other known networks. In general this information 

25 includes vectors of the identification codes of networks to be 
traversed to reach a destination network. Using this data, the 
edge nodes ascertain all the permissible paths to other 
networks and compare these with one another. Preferred paths 
are selected according to specified criteria, such as minimum 

30 number of networks to be traversed. 

Routing between the networks represents a sensitive point for 
the forwarding of traffic: 
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• The connection between two networks is a potential bottleneck 
at which no adequate bandwidth control is generally provided. 
As different networks are mainly operated by different 
independent companies, in general the topology information is 

5 not completely exchanged and mechanisms which are used within 
networks for traffic control are generally unavailable. 

• The connection of two networks constitutes a critical point 
in respect of disturbances and failures of network elements. 
The BGP protocol provides for the propagation of adapted 

10 topology information to the individual networks for 

recalculation of the inter-domain routing in the event of 
failures. This method frequently converges poorly and is in 
any case too slow to avoid impairment of the transmission of 
real-time traffic. 

15 

Packets are transmitted between networks or domains by means of 
routers which support a BGP (border gateway protocol) . The 
packets are transmitted from a BGP instance or BGP router to a 
BGP instance in another network. The term edge node will now be 
20 used for routers or nodes which can communicate with nodes in 
other networks. Edge nodes then generally support a BGP 
protocol. (BGP protocol is both a generic term and a protocol 
name) . 

25 The object of the invention is to specify methods which help to 
optimize routing between packet-oriented networks (inter-domain 
routing) . 

This object is achieved by the subject matter of the 
30 independent claims. 

The basis of the invention is that multipath routing methods 
are extended to the area between networks (inter-domain 
routing) . For this purpose packets sent from a packet-oriented 
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network to a destination are distributed over a plurality of 
links (e.g. 2) leading away from the network. 

Conventional multipath methods such as multipath MPLS or the 
5 KING concept for widening multipath routing to include inter- 
domain links (i.e. links connecting networks) can be extended 
to the intermediate area between packet-oriented networks as 
follows: The conventional methods generally define alternative 
paths between a start point and an end point (usually an entry 

10 or exit router of a network) . According to the invention, an 
edge node of a neighboring network to which two or more links 
lead can be used as the end point for multipath determination. 
In this way a plurality of links connecting the network to the 
neighboring network are included in the determination of 

15 alternative paths, i.e. traffic can be distributed over a 
plurality of inter-domain links. 

Alternatively, to define the paths and/or the distribution 
weightings, a plurality of neighboring edge routers of networks. 

20 via which the destination can be reached can also be combined 
to form a virtual end point or can be regarded as a virtual 
node. The defining of alternative paths then takes place 
between a node of the network and this virtual end point. The 
advantage of this approach is that traffic can be distributed 

25. over different edge routers of one or more neighboring 

networks, thereby reducing the effects of disturbances due to 
router failure. 

By means of the conventional methods such as multipath MPLS or 
30 multipath routing within the scope of the KING concept, 

different paths can be specified which extend from a start 
point within the network to the (virtual) end point outside the 
network, thereby defining inter-domain multipath routing 
between the network of the start point and the network or 
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networks in which the edge nodes constituting the virtual end 
point are located, it being possible to use the method 
according to the invention along a route through a plurality of 
networks, thereby allowing multipath routing along this route 
5 encompassing a plurality of networks, the individual networks 
being able to support different multipath routing methods (e.g. 
multipath MPLS, KING, ECMP) . 

According to a development, a plurality of edge nodes of the 
10 network exist through which traffic to be forwarded to the 
destination is transmitted via links to other networks. The 
packets forwarded to the destination can then be distributed 
over the edge nodes . 

15 Distributing the traffic over a plurality of paths reduces 
overloading of the inter-domain connections and adjacent 
routers and increases the availability of end-to-end 
connections. 

20 The extended multipath concept presented here has various 
advantages : 

A) Less overloading of border routers or edge nodes and intra- 
domain connections (i.e. connections of different networks) 

25 

The extended multipath concept presented here enables traffic 
to be evenly distributed throughout the network and beyond 
domain boundaries, thereby enabling overloading of individual 
connections and the components bordering the domains (inter- 
30 domain connections and border routers) to be reduced or 
prevented. 

B) Significant speeding-up of the convergence time in the event 
of border gateway (e.g. border router or edge node) failures. 
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When using conventional concepts, in the event of failure of a 
border router or its intra-domain connection, another border 
router is used to maintain the traffic flow. The routing tables 
5 of the autonomous system must be adapted to the new path. 

During reconfiguration of the routing tables, routing loops may 
arise in the network, packets are delayed by frequent changes 
to the routing tables, diverted onto longer paths, out of order 
or even lost. 

10 Using the proposed concept, no global reconfiguration (e.g. BGP 
followed by OSPF re-routing) is necessary. When failure of a 
border element is detected, a quickly executable local reaction 
(e.g. re-distribution of traffic) is sufficient to rectify the 
problem. The packets are automatically forwarded to the nearest 

15 border router e.g. analogously to intra-domain routing. 

C) Reduced complexity through using known concepts 

To specify the paths for multipath routing beyond network 
20 boundaries, the edge nodes of the adjacent networks via which 
the destination is reachable and via which traffic is to be 
routed to the destination are combined to form a virtual point. 
Conventional methods for determining alternative paths between 
a start and end point can then be applied. Routing mechanisms 
25 based on multipath routing, e.g. for responding to faults or 
disturbances, can likewise be used. By using known and tested 
algorithms and protocol parts of multipath MPLS, ECMP or KING, 
the complexity, implementation cost and fault proneness of the 
new inter-domain multipath concept is greatly reduced. 

30 

The invention will now be described in greater detail with 
reference to an exemplary embodiment and the accompanying 
drawings, in which: 
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Fig. 1: illustrates routing as part of the KING concept 

Fig. 2: illustrates routing as part of the MPLS -concept 

5 Fig. 3.: shows the dual homing concept 

Fig. 4: shows the redundant dual homing concept 

Fig. 5: shows the linking of a destination domain through 
10 different transit domains 

Fig. 6: illustrates the splitting of traffic and re-aggregation 
at an edge router using the multipath MPLS concept as an 
example 

15 

Fig. 7: shows the selection of suitable edge nodes as gateways 
for the destination domain 

Fig. 8: shows the combining of the gateways from Fig. 7 to form 
20 a virtual router 

Fig. 9: illustrates the incorporation of a virtual router into 
known intra-domain routing concepts in the case of the 
multipath MPLS concept 

25 

Fig. 10: shows, the configuration of the traversed routers of 
the network on the basis of known routing concepts 

Figs. 1 to 6 serve to illustrate the prior art and its 
30 attendant difficulties. 

Newer versions and developments of the iriter-domain routing 
protocols such as OSPF allow traffic to be distributed 
simultaneously over a plurality of alternative paths within a 
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domain. Examples of this are shown for the KING concept in Fig. 
1 and for the MPLS concept in Fig. 2. 

As part of the KING concept (Fig. 1), traffic is split locally 
5 at each router among so-called distribution compartments, i.e. 
alternative outgoing links from each node to a destination, the 
arrows shown in Fig. 1 specifying the distribution 
compartments. Splitting ratios are given by way of example. 

10 In contrast, with the MPLS concept (Fig. 2) splitting takes 
place at the entry node. The traffic is distributed over two 
alternative (MPLS) paths. A possible splitting ratio is again 
given . 

15 To protect against failure of a connection between two adjacent 
autonomous systems, so-called dual homing concepts are used. 
Dual homing means using two or more possible connections 
between autonomous systems (Fig. 3).. In the case of crosswise 
implemented connections, the term redundant dual homing is used 

20 (Fig. 4) . 

In highly meshed networks it is also possible to reach 
destination networks or destination domains via various transit 
networks (Fig. 5) . Even in the event of failure of the routing 

25 functions of a transit network, a destination network is still 
reachable by this means, thereby enabling expensive and complex 
redundancy structures of edge nodes or border routers to be 
eliminated. Conventionally one path is used. The path shown in 
Fig. 5 is stored, for example, as a standby path and is put 

30 into operation when the first path is reported to have failed. 

With the existing concepts such as multipath MPLS (Fig. 2) and 
the KING concept (Fig. 1) , traffic is split among a plurality 
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of paths within a network and re-aggregated at the selected 
edge node or border gateway router. 

Possible overloading of the connections between the networks 
5 (inter-domain connection) and of the edge nodes used 

considerably reduces the throughput of the network in the 
direction of a remote destination address as well as its 
availability. Fig. 6 shows, for two MPLS networks with 
multipath routing, that a potential bottleneck or weakness 
10 exists between the networks . There is a risk of overloading the 
inter-network connection. 

According to the invention, the idea of simultaneously using a 
plurality of paths (multipath) is extended beyond the network 
15 boundaries or domain boundaries . 

The traffic leaves the autonomous system if possible on a 
plurality of alternative links or paths simultaneously. The 
number of links on which traffic to one or more networks is 
forwarded to a destination can be two or more. 

20 

The proposed concept will now be described in greater detail: 
To calculate the possible paths and the traffic distribution 
weightings, the edge routers or border gateway routers of the 
adjacent domains leading to a destination are combined to form 

25 a virtual router. This is illustrated more precisely in Figs. 7 
and 8. Fig. 7 shows two edge nodes (border routers) via which 
packets coming from a source on different paths can be 
forwarded to a destination. To calculate paths and distribution 
weightings within the network, the view shown in Fig. 8 is 

30 used. The edge routers of neighboring networks which are 

reachable from the edge routers of the network for transmission 
to the destination are combined to form a virtual router. This 
has advantages when using conventional methods. Both of them, 
the KING concept (Fig. 1) and the MPLS multipath concept (Fig. 
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2) , provide alternative paths between a start point and an end 
point. Conventionally, the start and end point are determined 
by the network's entry router and exit router used for routing 
to the destination. Within the scope of the invention, the end 
5 point for calculating alternative paths can be extended beyond 
the network boundary. By combining the neighboring edge nodes 
lying in other networks to form a virtual node,, the existing 
concepts (which are based on an end point) can be applied 
without complex and costly modifications of the protocols to 
10 the situation according to the invention with extension of 
multipath routing to the area between the networks . 

This is shown in greater detail in Fig. 9. Between a source or 
a start point and an end point constituted by the virtual 

15 router, various MPLS paths and associated distribution 

weightings or splitting ratios are specified as part of the 
multipath MPLS concept. This means that incorporating the 
resulting virtual routers into the intra-domain routing 
concept allows the known, tried and tested algorithms and 

20 methods to be used. 

Fig. 10 shows a scenario corresponding to Fig. 9, not as in 
Fig. 9 from the point of view of specifying MPLS paths, but 
from the point of view of configuring the edge routers. The 

25 two edge routers are configured such that the incoming 

traffic is sent to the destination on the outgoing links in 
the destination direction. In the example in Fig. 10 there 
are two paths from the network to the destination via any 
transit networks over which the traffic to be routed to the 

30 destination is distributed. Two of the four MPLS paths 

shown in Fig. 9 coincide on these two paths in each case, 
which involves a corresponding accumulation of traffic 
outside the network. The individual routers within the 
network including the edge routers can be configured in 
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accordance with the conventionally used intra-domain 
routing methods. The individual edge routers do not 
therefore see a virtual router, but the edge routers of the 
neighboring networks to which packets are forwarded 
5 according to the routing tables. 



